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We present results of Monte Carlo simulations, using parallel tempering, on the three- and four- 
dimensional Edwards- Anderson Ising spin glass with Gaussian couplings at low temperatures with 
free boundary conditions. Our results suggest that the surface of large-scale low-energy excitations 
may be space filling. The data implies that the energy of these excitations increases with increasing 
system size for small systems, but we see evidence in three dimensions, where we have a greater range 
of sizes, for a crossover to a regime where the energy is independent of system size, in accordance 
with replica symmetry breaking. 
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I. INTRODUCTION 



Recently there have been several studieai'cHQtlla'Ll that 
attempt to better understand the nature of the spin-glass 
state through zero-temperature calculations. Whereas 
these calculations have used different versions of the 
heuristic genetic algorithm, recentljj-, the exact branch 
and cut algorithm has been appliccE to the Edwards- 
Anderson Ising spin glass with free boundary conditions. 
In part, this choice of boundary conditions has been mo- 
tivated by the algorithm being more efficient for free than 
periodic boundary conditions. However, in addition, use 
of a different boundary condition also allows one to study 
the role that boundary conditions play, and perhaps even- 
tually to deduce the optimal choice of boundary condi- 
tions for numerical studies. 

There have been two principle scenarios proposed 
for thc..|SEin-glass state. In replica symmetry breaking 
(RSB)ErEj large-scale low-energy excitations of the sys- 
tem cost a finite energy in the thermodynamic limit and 
have a surface that is space filling, i.e. the fractal dimen- 
sion of the surface, ds, is equal to the space dimension 
d. In the other commoj aht d iscussed scenario, called the 
droplet picture (DP),tilll3ll3 it is argued that the lowest- 
energy excitation with linear spatial extent L and involv- 
ing a given spin typically costs an energy , where is a 
(positive) exponent. Hence, in the thermodynamic limit, 
these excitations cost an infinite energy. In addition, it is 
predicted that the surface of these excitations is fractal 
with ds < d. 

An intermediate picture between RSB and the DP 
has also been proposed by Krzakala and Martina and 
Palassini and Young3 (KMPY) on the basis of numeri- 
cal calculations at T = (see also Ref . ^ for analogous 
calculations at finite-T). In this scenario, large-scale low- 
energy excitations cost a finite energy in the thermody- 
namic limil|-.but their surface is fractal. There are two 
exponentsEltl that describe the energy dependence of the 
system size: 9 (> 0), where is the typical change in 
energy when the boundary conditions are changed, as 
originally proposed by the droplet model, and 9' , where 



characterizes the energy of system-size excitations 
thermally excited within the system for a fixed set of 
boundary conditions. 

The data of Refs. || and ^ for periodic boundary con- 
ditions agree well with the KMPY scenario, while agree- 
ment with RSB would require large corrections to scaling. 
However, the results of Ref. ^appear to be somewhat dif- 
ferent. They are compatible with RSB but it cannot be 
excluded that this is a finite-size effect due to large cor- 
rections with free boundary conditions, so the KMPY or 
droplet pictures cannot be ruled out. 

In this work we perform finite temperature Monte 
Carlo simulations of the three- and four-dimensional 
Edwards- Anderson (EA) Ising spin glass with free bound- 
ary conditions at finite but low temperatures. We find 
results that are consistent with the ground-state calcula- 
tions of Ref. H 

To investigate differences between the models men- 
tioned i t is J i^yfal to look at the distribution of t he ii Sjpjn. 
overlapjlaMUH P{q). In the droplet picturePMEll 
P{q) is trivial in the thermodynamic limit, i.e., there are 
only two peaks at ±(7ea (<Zea is the Edwards- Anderson 
order parameter). For finite systems of linear size L, 
there is a tail with weight ~ down to g = 0. Con- 
versely, RSB predicts a tail with a finite weight down to 
q — independent of system size. In addition, the vari- 
ance of the distribution of the link overlap qi (introduced 
below) can shed some light on the surface of the excita- 
tions: the droplet picture predicts that the variance of 
the link overlap has a power-law decay Var(g;) ~ iy"''', 
whereEfl ^ 9' + 2{d — ds). Because RSB predicts that 
the surface of the low-energy excitations is space-filling 
and, in addition, that system-size excitations cost only 
a finite energy, one expects that Var(g/) — > const for 
L — > oo. 

The layout of the paper is as follows: In Sec. II, we 
describe the model as well as the observables measured. 



while in Sec. Ill, we discuss our equilibration tests for the 
parallel tempering Monte Carlo method. Our results are 
presented in Sec. IV and the conclusions summarized in 
Sec.0. 
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FIG. 1: Sketch of the effect of different boundary conditions 
on domain waUs. For simphcity, we show a sample in two 
dimensions. The sohd hne with curvature represents a domain 
walL Periodic boundary conditions (pbc) restrict the domain 
waU to enter and exit the sample at corresponding points on 
the top and bottom surfaces. This is not the case for free 
boundary conditions (fbc) where the domain wall can enter 
and exit the sample at arbitrary points. 



II. MODEL AND OBSERVABLES 

The Hamiltonian of the Edwards- Anderson Ising spin 
glass is given by 



H. — ^ JijSiSj 



(1) 



where the sites i lie on a hypercubic lattice in dimension 
d = 3 or 4 with N ~ L'^ sites [L < 8 in three dimen- 
sions (3D), L < 5 in four dimensions (4D)], Si = ±1, 
and the Jij are the nearest-neighbor interactions chosen 
according to a Gaussian distribution with zero mean and 
standard deviation unity. Free boundary conditions are 
applied. Applying free boundary conditions has the ad- 
vantage that domain walls are not restricted to enter and 
exit the sample at the corresponding point on opposite 
sides of the system, as sketched in Fig. ^ 

Our attention focuses primarily on two quantities: the 
spin overlap q, defined by 



1 ^ 

1 \^ c(l)o(2) 
i=l 



(2) 



where "(1)" and "(2)" refer to two copies (repHcas) of 
the system with identical bonds, and the link overlap, g;, 
defined by 
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1 c.(l) c(2) o(2) c.(2) 



Nb 



(3) 



In the last equation, Ni, = dL'^~^{L — 1) is the number 
of bonds, and the sum is over all pairs of spins i and j 
connected by bonds. 

If two spin configurations differ by flipping a large clus- 
ter then q differs from unity by an amount proportional 
to the volume of the cluster while qi differs from unity by 
an amount proportional to the surface of the cluster. 



III. EQUILIBRATION 



For the simulatioias._^e use the parallel tempering 



Monte Carlo metho ddffas it allows us to study larger 
systems at lower temperatures. We test equilibration 
with the method introduced by Katzgraber et al. in 
Ref. |l| for short -range spin glasses with a Gaussian dis- 
tribution of exchange interactions. It depends on an ex- 
pression that relates the average energy per spin |C/| to 
the average link overlap: 



' {qi) ]av = 1 - 



T\U\N 



(4) 



where [• ■ -Jav denotes an average over samples, and (• • ■) 
denotes a thermal average. 

We choose a set of temperatures T^, z = 1, 2, • ■ • , Nt, 
so that the acceptance ratios for the global moves are 
satisfactory, typically greater than 0.3 for d = 3,4. The 
simulation is started with randomly chosen spins so that 
all replicas are uncorrelated. This has the effect that both 
sides of Eq. (jj) are approached from opposite directions. 
Once they agree, the system is in equilibrium, as can 
be seen in Fig. || for T = 0.2, the lowest temperature 
simulated, with L = 4, d = 3. We show data for a smaller 
size as it allows us to generate more samples for longer 
equilibration times to better illustrate the method. For 
larger system sizes, we stop the simulation once the data 
for [ ]av and 1 - T\U\N/Ni, agree. 

In order to calculate the spin and link overlaps in 
Eqs. (^ and (||) we use two replicas for each temperature, 
and so the total number of replicas in the simulations is 
2Nt. 



IV. RESULTS 
A. Three dimensions 

In Table ^, we show iVgamp, the number of samples, 
Nswcc-p, the total number of sweeps performed by each set 
of spins (replicas), and Nt, the number of temperature 
values, used in the simulations. For all sizes the largest 
temperature is 2iLand the lowest 0.20 (to be compared 
with Tc ~ 0.95) O The temperatures are chosen in or- 
der for the acceptance ratios of the global moves to be 
typically bigger than 0.3 for the largest size ofL — 8. 

Figures p| and ^ show data for the spin overlap distri- 
bution P{q) for temperatures 0.20 and 0.50 respectively. 
For low enough temperatures, our data are consistent 
with P(0) oc T. There is a large peak for large val- 
ues of q and a tail that depends slightly on the system 
size. To determine more precisely the size dependence of 
P(0), we average over data points with \q\ < qo, where 
qo — 0.20. Different values for qo give comparable results 
within error bars. The results are shown in Fig. |^. Since 
the droplet model predicts that P(0) should vary as , 
and the value of 6 obtained in nurncjripal studies involv- 
ing boundary condition changesSoO is about 0.20, we 
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FIG. 2: The average link overlap [{qi)]av, and qi{U) [the 
right-hand side of Eq. (^)], as a function of the number of 
Monte Carlo sweeps, A'swocp, which each of the replicas per- 
form for d = 3, T = 0.2, and L = 4. Thermal averaging was 
performed over the last half of the sweeps indicated. The two 
sets of data approach each other from opposite directions and 
then do not appear to change at larger number of sweeps, 
indicating that they have equilibrated. We also show data 
for the average first, second and fourth moments of q. They 
appear to be independent of the number of sweeps once the 
data for qi has equilibrated. 



TABLE I: Parameters of the simulations in three dimensions 
with free boundary conditions. A^samp is the number of sam- 
ples (i.e., sets of bonds), Nsvacp is the total number of sweeps 
simulated for each of the 2Nt replicas for a single sample, 
and Nt is the number of temperatures used in the parallel 
tempering method. 



L 


-/Vsamp 


A^swccp 


Nt 


3 


20000 


1.0 X lO"* 


18 


4 


20000 


1.0 X 10* 


18 


5 


10000 


1.6 X lO'^ 


18 


6 


10000 


3.0 X 10^ 


18 


7 


5000 


1.0 X 10® 


18 


8 


5000 


1.0 X 10'^ 


18 


9 


5000 


3.0 X 10'^ 


18 



indicate, by the dashed line in Fig. ^, a slope of —0.20. 
For low temperatures and small sizes the data are com- 
patible with this droplet theory prediction. However, we 
see evidence for crossover to a behavior where P(0) is 
independent of L at larger system sizes, which would be 
consistent with RSB. 

Fitting the data in Fig. ^ to the form aL^^ for L < 7, 



FIG. 3; Data for the overlap distribution P{q) in 3D at T = 
0.20 with free boundary conditions. Note that the vertical 
scale is logarithmic to better make visible both the peaks at 
large q and the tail down to g = 0. The lines go through all 
the data points but, for clarity, only some of the data points 
are shown as points. 



we obtain 6' = 0.19 ± 0.03 for T = 0.20, 6' = 0.15 ± 
0.02 for T = 0.34, and 9' = 0.05 ± 0.02 for T =j-4)-50. 
The goodness-of-fit probabihties Q for these fitaSl are 
0.912, 0.703, and 0.384 for T = 0.20, 0.34, and 0.50, 
respectively. If we fix 9' — 0, the RSB prediction, and 
attempt a fit to all values of L as well as a subset with 
L < 7 the goodness-of-fit probabilities are smaller than 
10-6 for T = 0.20 and 0.34 and 0.017 for T = 0.50 , 
which are rather poor. We also find that fixing 9' = for 
L > 7 is more probable than 9' = 0.20. 

Figures H and |^ show data for the link overlap qi atT — 
0.20 and 0.50, respectively. We see a large peak for large 
qi values. The data for T ~ 0.20 show a small shoulder 
for smaller qi values. This feature has been observed in 
Ref. |l|. 

Figure ^ shows data for the variance of P{qi) at several 
temperatures. We attempt two fits of the form 

Y&Y{qi)^a + bL-'^ (5) 

and 

Var(<70 = dL-" . (6) 

Table || shows the relevant parameters for the three- 
parameter fits to Eq. (|^). From our data, we see a finite 
value of a for the sizes studied, a result that implies d = 
ds, as expected in RSB. A two-parameter fit of the form 
Var((7;) ~ L~f^' in Eq. (|^) does not seem plausible given 
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FIG. 4; Same as for Fig. H but at T = 0.50. 



TABLE II: Fits for Var(gi) for the three-dimensional EA 
Ising spin-glass with free boundary conditions to the form in 
Eq. (P) . We show the data for different temperatures and find 
a finite value for a. The fit probabilities Q are reasonable for 
the lower temperatures. 



T 


a 


b 


c 





0.20 
0.34 
0.50 


0.0032 ± 0.0002 
0.0027 ± 0.0003 
0.0017 ± 0.0002 


0.228 ± 0.006 
0.349 ± 0.014 
0.463 ±0.014 


1.860 ±0.025 
1.937 ±0.038 
2.072 ± 0.029 


0.819 
0.003 
0.000011 



the small fitting probabilities Q of 10"^^, 10"^^, and 0.0 
for T = 0.20, 0.34, and 0.50, respectively. Similar results 
are found for zero-temperature calculationsEl. 

However, given the modest range of sizes studied, and 
the likelihood that there are strong finite-size corrections 
with free boundary conditions, we cannot rule out that 
asymptotically one has a = 0, implying dg < d. Evi- 
dence for large finite-size corrections with free boundary 
conditions comes from our estimates for Tc, which are 
inconsistent with known resultscJ by ^ 10%. 



B. Four dimensions 

Table |l| shows the parameters of the simulation in 
four dimensions. Our lowest simulated temperature is 
0.20 (to be compared with Tc ~ 1.80)c3 and the largest 
is 2.80. We use the same temperature set for each size 
studied. The acceptance ratios for the parallel tempering 
method are typically greater than 0.3. 

Figures p| and 11^ show data for P{q) at temperatures 



FIG. 5: Log- log plot of P(0), the spin overlap at g = 0, 
against L in 3D with free boundary conditions averaged over 
the range \q\ < qo — 0.20. The data slightly depend on system 
size. The dashed line has slope —0.20, the estimated value of 
—6 according to the droplet picture. 
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FIG. 6: The distribution of the Unk overlap in 3D at T = 0.20 
with free boundary conditions for different sizes. Note the 
logarithmic vertical scale. 
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FIG. 7: Same as for Fig. H but at T = 0.50. 



FIG. 9; Data for the overlap distribution P{q) in 4D at T = 
0.20 with free boundary conditions. The data are normalized, 
so the area under the curve is unity. 
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FIG. 8: Log-log plot of the variance of qi as a function of size 


in 3D at several temperatures. 


The dashed hnes correspond 


to fits of the form yi = 


a + bL~ 
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TABLE III: Parameters of the simulations in four dimensions 


with free boundary conditions. 






L 


samp 




sweep 


Nt 


3 


10000 




6 x 10=^ 


23 


4 


10000 




6 X lO" 


23 


5 


5000 




5 X 10^ 


23 



0.20 and 0.46. As in three dimensions, the tail of the dis- 
tribution depends on the system size L. To better quan- 
tify this behavior, we show in Fig. 11 data for P(0) vs L 
averaged over the range |q^j^).20. Since the DP predicts 
that P(0) ~ L-^ wher<£3kj 9 ~ 0.7 we also indicate 
this behavior by the dashed line in the figure. The data 
is reasonably consistent with this. Fixing 6' — 0.70 and 
performing a fit of the form aL~^ , we find goodness-of-fit 
probabilities Q of 0.53, 0.44, and 0.21 for T = 0.20, 0.25, 
and 0.32, respectively. Fixing 9' = gives us goodness- 
of-fit probabilities Q < 10""*. Unfortunately, our modest 
range of sizes does not permit us to make more quan- 
titative statements and a crossover to a behavior where 
P(0) ~ L'-' cannot be excluded. As in three dimensions, 
our data is consistent with P(0) oc T for T ^ 0. 

The data for the distribution of the link overlap is 
shown in Figs. |l^ and |l3| for temperatures 0.20 and 0.46, 
respectively. As in three dimensions, we see a double- 
peak structure. 

In Fig. |l^ we show the variance of the link overlap qi 
as a function of system size for several low temperatures. 
We perform fits to the functions indicated in Eqs. (||) and 
. Table |l^ shows the results of the three-parameter 
fits to Eq. The best fit has a > 0, a result compati- 
ble with RSB, but, because we have the same number of 
data points as parameters, we cannot give an error bar 
or fit probability Q. Table ^ shows the results of the 
two-parameter fits to Eq. (^). The goodness-of-fit prob- 
abilities are quite small, but not impossibly so for small 
T, so we cannot rule out a scenario in which Var(q;) — > 
for L —>■ oo. 
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FIG. 10: Same as for Fig. | but at T = 0.46. 



FIG. 12: The distribution of the link overlap in 4D at T = 
0.20 for different sizes with free boundary conditions. Note 
the logarithmic vertical scale. 





FIG. 11: Log-log plot of P(0) against L in 4D averaged over 
the range \q\ < qo — 0.20. For small sizes a decrease in P{0) 
with increasing system size is visible. 



FIG. 13: Same as for Fig. |l^ but at temperature 0.46. 



V. CONCLUSIONS 

We have performed Monte Carlo simulations of the 
three- and four-dimensional EA Ising spin glass with free 
boundary conditions. For small sizes, we find P{0) ~ 
with 9' > 0. The values of 9' we obtain for the 



lowest temperatures simulated are compatible with pre- 
dictions from the droplet model. However, in three di- 
mensions, we find evidence for crossover to a behavior 
where -P(O) ~ L'-^ for larger system sizes. In four di- 
mensions, where the range of sizes is smaller, we do not 
see evidence for this crossover. An analysis of our results 
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TABLE IV: Fits for Var(gi) for the four-dimensional EA Ising 
spin glass with free boundary conditions for the fit in Eq. ^ . 
We show the data for different temperatures and find a finite 
value for a. We cannot quote error bars or fitting probabilities 
since we have the same number of data points as variables. 

_T a b c 

0.20 0.0063 0.I5I7 2.0156 

0.32 0.0057 0.1980 1.9342 

0.46 0.0057 0.2729 2.1285 



are on the surface, there is also a compensating benefit 
in that they do not pose any restrictions on the position 
of domain walls (see Fig. |l|). It would be interesting 
to investigate what the optimal boundary conditions for 
spin-glass studies. 



TABLE V: Fits for Var(gi) for the four-dimensional EA Ising 
spin glass with free boundary conditions for the fit in Eq. ^ . 
The probabilities for the fit are quite small but not impossibly 
so for small T. 



T 


d 


e 


Q 


0.20 


0.090 ± 0.008 


1.255 ± 0.005 


0.09 


0.32 


0.137 ±0.010 


1.406 ± 0.003 


0.05 


0.46 


0.179 ±0.015 


1.572 ± 0.002 


0.0008 



indicates that the surface of these excitations is space fill- 
ing, corresponding to RSB. However, since free boundary 
conditions have large finite-size corrections, it is not clear 
if these results represent the asymptotic behavior. Over- 
all, our results are quite similar to those of Ref. ^, which 
were obtained at zero temperature. 

Although free boundary conditions have large finite- 
size corrections because a substantial fraction of spins 
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FIG. 14: Log-log plot of the variance of qi as a function of size 
in 4D at several temperatures with free boundary conditions. 
The data do not fit well to a power law. 
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